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Abstract. The rigidity of a matrix describes the minimal number of en- 
tries one has to change to reduce matrix's rank to r. We give very simple 
combinatorial proof of the lower bound for the rigidity of Sylvester (spe- 
cial case of Hadamard) matrix that matches the best known result by de 
Wolf(2005) for Hadamard matrices proved by quantum information theo- 
retical arguments. 

1 Introduction 

1.1 Problem 

Changing some entries of a complex matrix can reduce its rank. The rigidity of 
a matrix M is the function Rm{t)^ which for a given rank r, gives the minimum 
number of entries of M which one has to change in order to reduce M's rank to 
r or less. More formally, 

R M (r) = min {weight(M — M)}, 

rank(M)<r 

where weight denotes the number of non-zero entries. In other words, large rigidity 
shows that the matrix's rank is stable under perturbations. It is easy to see that 
Rm(t) > n ~ r for any full rank matrix M, because change of one entry reduces 
the rank by at most 1. 

1.2 History 

In this section I survey all known results for the matrix rigidity over infinite fields 
up to my best knowledge. There have been done a lot of work on rigidity on finite 
fields 0] and on restricted and generalized versions of the rigidity problem as well 

El 

The rigidity was defined by Valiant |23I24| ; a similar notion independently was 
proposed by Grigoriev [BJ. The main motivation to study rigidity is that good 
lower bounds on rigidity would give important complexity results in other com- 
putational models, like linear algebraic circuits and communication complexity. 
For communication complexity (0, l)-matrices are especially important. Valiant 
showed Rm{t) > (n — r) 2 for "almost all" matrices M. Pudlak and Rodl 16 



showed a similar result for (0, l)-matrices. However, to show a good lower bound 
for an explicit matrix still remains unsolved task. 

The most interesting matrix probably is Hadamard matrix. Pudlak and Savicky 
[TH| showed that for any Hadamard matrix H, Rij(r) = ^( r 4™ og 'i r ), Razborov PT] 

improved their result to Rh{t) = i?( ra " ogr ). Grigoriev 5 and Nisan J3| indepen- 
dently observed an easy method to get lower bound for any totally non-singular 
matrix M (i.e. a matrix in which all submatrices are non-singular) Rm{t) — 
]?(—). Similar strategy was used by Alon £Q to improve rigidity of Hadamard 
matrix Rh{t) — &{\), LokamfH?) to give an alternate proof of the same result, 
Kashin and Razborov |S] to prove -Ry(r) > and de Wolf|25j to use quantum 

information theoretical arguments to give a neat proof of Rh (r) > ^- (the last 
result holds for any orthogonal matrix where all entries have the same magnitude, 
including Discrete Fourier Transform). 

There are results for other matrices as well. Razborov [201 showed Rm(t) — 
O(^r) if M is the generalized Fourier Transform matrix or the inverse of the 
Vandermonde matrix. Kimmel and Settle^ gave the lower of the rigidity of the 
triangular matrix T, their result in simplified form looks like Rt{t) ~ i7(^r). 
Independently, Pudlak and Vavrin |19j determined the exact value of T, partic- 
ulary, for a large n but small r it is like Rt(t) ~ j^- Pudlak 15 showed that 

Rm{t) = ^(^V) if M belongs to a class of matrices called Densely Regular, that 
includes triangular matrix, Vandermonde matrices, shifters and parity shifters. 
Shokrollahi et al. 22^ showed that i?c( r ) = log— ) for a Cauchy matrix 

C. Codenotti et al.[3] studied the rigidity of some matrices under combinatorial 
assumptions. 

Lokam [T2lllj gives some quadratic lower bounds for "less explicit" matrices. 
Landsberg et al. 10 gave geometrical interpretation of matrix rigidity. 

However, these results do not give a superlinear rigidity for an explicit matrix 
when r — 0(n). LokamXJj observes that a method used in all those results (and 
this paper as well) by getting " candidate" matrices that are close to full rank does 
not give a results like R{r) = u>{— log — ). 

Codenotti gives a survey paper on the matrix rigidity problem as well as 
some interesting problems. 

In this paper we give a simple proof in "three lines" of Rs(r) > ?r for any 
Sylvester matrix S (special case of Hadamard matrix). The same proof works 
for other "well behaved" matrices, like Discrete Fourier Transform. However, our 
main contribution is the simplicity of the proof. 

1.3 Matrices 

If A — iflij) and B = (bki) are matrices of size m x n and p x q respectively, the 
Kronecker product A Cg> B is the mp x nq matrix made up of p x q blocks, where 
the (k,l) block is bkiA, 

Sylvester matrix S(n) of order n :— 2 k is n x n matrix made by iterating 
Kronecker product of k copies of the following matrix 



5(2) 



+ - 



where + and — denotes +1 and — 1 respectively. 
For example, 

/+ + + +\ 

5(4) = 



+ - + - 
+ + - - 

V+--+7 



Sylvester matrices are special case of Hadamard matrices. A real valued matrix 
H is called Hadamard matrix iff HH T = nl. 

Discrete Fourier Transform is n x n matrix FN(n) = (fjk) defined by fjk := 
w^' -1 )^ -1 ), where w := e~^~ and i := V^T. 



2 Proof 

Theorem 1 If S(n) is a Sylvester matrix and r < n/2 is a power of 2 then 

2 

n 

Rs(n)(r) > — . 

In other words, for any n x n matrix 5 such that rank(S) < r holds 

weight(S(n) -S)> 



n 2 



4r 

Proof. Assume the opposite, weight(S(n) — 5) < Let uniformly divide 5 in 
(ir) 2 submatrices 5i 3 of size 2r x 2r. By a counting argument, there exists i, j s.t. 
weight(S(2r) — Sij) < r. Thus, rank(S) > rank(Sij) > 2r — r = r. Contradiction. 

□ 

2 

The same proof works for RFT(n)( r ) — f^i where FT(n) denotes nxn Discrete 
Fourier Transform matrix, because DFT matrix where columns with even indexes 
are written first is represented as a matrix 

fFT(n/2) ujiFT{n/2) 
\FT(n/2) -uj3- n l 2 FT{n/2) 

where j denote the index of a row. Since rows of a FT(n) are orthogonal and 
multiplication by some constant does not change this property, each submatrix 
can be recursively divided again and again, by getting full rank submatrices. This 
is the only property of matrices wc need in the proof. 
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